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(54) REAL TIME IMAGE ENHANCEMENT TECHNIQUE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To improve an image state 
which the human eye perceives by applying first and 
second transformation functions to a luminance value 
and a saturation value within the finite range of a color 
image and transforming them so that they correspond to 
a whole dynamic range. 

SOLUTION: The color image is expressed again by 
multiplex picture elements showing the whole range of 
the luminance value and the saturation value in a hue, 
saturation and luminance (HSV) space. The luminance 
value of the image is transformed by using a sectional 
linear mapping function 102 and the like for the 
luminance component for the color picture. A second 
transformation number decided by giving an extension 
procedure to a saturation histogram showing the 
saturation component of an original picture is applied to 
the saturation component and the saturation value is 
transformed. Then, enhancement for putting saturation 
and luminance to both ends of an area is executed 

without mixing the distortion of colors and the optimum picture is obtained. 
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precisely. 
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CLAIMS 

[Claim(s)] 

[Claim 1] It is the approach of emphasizing a color picture using the video processing system 
equipped since the dynamic range of a brightness value and the dynamic range of a saturation 
value were expressed. The step showing the color picture which has the brightness value and 
saturation value of the range of finite by two or more pixels which can be set to HSV (hue, 
saturation, and brightness) color space, It is the step which applies the 1st transform function to 
the brightness value of the range of this finite, and applies the 2nd transform function to the 
saturation value of the range of this finite. This 1st transform function It is what changes the 
brightness value of the range of this 1st finite so that it may correspond to all the dynamic 
ranges of a brightness value. This 2nd transform function The step which is what changes the 
saturation value of the range of this finite so that it may correspond to all the dynamic ranges of 
a saturation value is included. By this How to emphasize the color picture these whose 1st and 
2nd transform functions are what offers the emphasized image which has the brightness value 
and saturation value which were fully optimized. 

[Claim 2] It is the approach indicated by claim 1 and is a piecewise linear mapping function in 
three dimensions [ two ] as which this 1st transform function is specified by four brightness 
value points and which have a linearity field substantially. In the approach of being what this 1st 
dimension expresses the brightness value of this finite range, and this 2nd dimension expresses 
the dynamic range of a brightness value to The step which furthermore specifies the 1st 
brightness value point as what is expressed with the minimum brightness in an image, it can set 
into the step which specifies the 2nd brightness value point as what is expressed with the 
maximum brightness value in an image, and this 1st dimension — this — the approach of 
emphasizing the color picture which is a thing containing the step which chooses the 3rd [ which 
has a value between the 1st and 2nd brightness value points ], and 4th brightness value points. 
[Claim 3] Are the approach indicated by claim 2 and this piecewise linear mapping function 
consists of the 1st, 2nd, and 3rd railroad section drawings. The 2nd railroad section drawing is 
prescribed by Points vlower and vupper. this — between the 1st railroad section specifies with 
Points vmin and vlower — having — this — In an approach which is the minimum brightness 
value [ in / the 3rd railroad section drawing is prescribed by Points vuppr and vmax, and / in 
vmin / an image ], and is the maximum brightness value [ in / in vmax / an image ] and — this — 
- Including the step which is furthermore based insufficient [ relative overexposure or exposure 
of an image ], and chooses vlower and vupper, when an image is underexposure relatively Are 
chosen so that vlower may approach relatively [ vmin ], and it is chosen so that vupper may 
keep away from vmax relatively. This compresses a high brightness value and a low brightness 
value is elongated. An image relatively in the case of overexposure How to be chosen so that 
vupper may approach relatively [ vmax ], and to emphasize the color picture which is chosen so 
that vlower may keep away from vmin relatively, compresses a thereby more low brightness 
value, and elongates a higher brightness value. 

[Claim 4] It is the step which generates a brightness value histogram about the image which 
should be emphasized in the approach indicated by claim 3 by dividing the range from vmin and 
vmax into the two or more secondary range for vupper and vlower. The number of pixels of the 
image which has a brightness value in this subrange about each of two or more of these 



subrange is calculated. The center of gravity of this brightness value histogram is specified as 
the 1st moment, and it becomes the display related insufficient [ relative overexposure or 
exposure of an image ]. This 1st moment The step which is approaching more relatively to vmin 
rather than vmax about the image with insufficient exposure, and is approaching more relatively 
to vmax rather than vmin about the image of overexposure, vupper increases and vlower 
decreases as this 1st moment approaches vmin gradually. And the method of emphasizing the 
color picture which is what is calculated by carrying out the step which chooses vlower and 
vupper so that vupper may decrease and vlower may increase as this 1st moment approaches 
vmax gradually. 

[Claim 5] It is the step which ** all the dynamic ranges of this video processing-system value on 
the strength as [VMIN, VMAX] in the step indicated by claim 4. The step which is what is 
substantially equivalent to the minimum brightness value as which VMIN may be expressed in 
this video processing system, and is substantially equivalent to the maximum brightness value as 
which VMAX may be expressed in this video processing system, It is the step which maps the 
brightness value in the range of vmin in this 1st dimension, and vlower at linearity in the 
brightness value in the range of VMIN of this second origin, and VLOWER. 
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DETAILED DESCRIPTION 
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[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] Generally this invention relates to carrying out real-time image 
enhancement to a text logic color precision image especially about image enhancement 
technique. 
[0002] 

[Description of the Prior Art] Image enhancement is the process in which the demanded image 
data value is processed skillfully. Such processing is turned in the direction which reaches in 
order to improve the condition of the image perceived by human being, or draws the data more 
preferably to the mechanical analysis of an image, the fidelity of the image with which one 
purpose of two or more correction processes carried out regeneration of two or more image 
enhancement processes about the image — and — or in the point that it is for improving 
precision, it is distinguished from two or more image restoration processes, on the other hand, 
the candidate for consciousness which is visible to human being as for two or more emphasis 
processes — and — or on the compatibility of the processed image to computer analysis, it has 
positioned so that it may emphasize more. 

[0003] Various image enhancement processes were developed in order to improve the quality of 
the perceived articulation, brightness, and/or an image. These image enhancement processes try 
to draw ** better ****** of a twist to human being's eyes regardless of whether these images 
are generated again correctly. There is often a desirable image by human being's eyes rather 
than the copy of a subject-copy image with the bent perfect image which carried out 
regeneration. For example, when overexposure or underexposure is compounded by the edge of 
an image, the image obtained as a result is generally perceived as a thing more desirable than an 
image without such underexposure or overexposure. 

[0004] Although many conventional technical image enhancement processes are concentrating 
on the improvement of a shade image, the directivity escape of these processings to a color field 
results in the image which is grace and which is not a little suitable, or it fell. At present, a most 
suitable image enhancement technique that deserves the attention which can be used about a 
color picture is insufficient. The far-reaching spread in, popular increases of multimedia 
application, the rapid increments in computer equipment, and all the development of HDTV serve 
as a cause of the increment in the demand to the improved color picture emphasis technique. 
Such an image enhancement approach should be optimized to using about a color picture, and 
should not be [ as opposed to / only / a color field ] reconstruction of a gray shade means. 
Furthermore, such an image enhancement approach should be actuation of the real time of using 
by the existing hardware platform. 

[0005] Even if it is possible to improve a color picture by applying a certain monochrome image 
enhancement algorithm now to each color component of each, the image as a result is not 
emphasized appropriately. When an R.G.B component is seen in piles after the monochrome 
image enhancement algorithm was applied, image distortion appears as a result. Furthermore, if 
an R.G.B component is processed independently, only image distortion will appear as a result, 
without taking the relevance of these components into consideration. 
[0006] 



[Problem(s) to be Solved by the Invention] The gray level image was targetted for many 
conventional image enhancement techniques. When such techniques are applied to a color 
picture, color distortion is caused in many cases. Therefore, this invention is applying the 
transform function corresponding to the property of a color picture, and is offering the approach 
of improving the condition of the image perceived by human being's eye. 
[0007] 

[Summary of the Invention] Two or more improved image enhancement approaches are shown 
on the conventional video processing system. These approaches perform in the real time 
reaching in order to improve the condition of the image which human beings eye has perceived, 
or improving **'s and others image to computer analysis. The first example emphasizes a color 
picture, without dropping the color reproduction nature of an image. The 2nd example decreases 
dotage of an image and emphasizes a gray level text image by removal of the image artifact 
which is made to increase the contrast between light and darkness, and is introduced by the 
conventional block-type compression algorithm. 

[0008] According to the first example, a color picture is re-expressed by many pixels in HSV 
space (a hue, saturation, brightness). The color picture shows all the range of a brightness value 
and a saturation value. An image is emphasized by applying the second transform function to a 
saturation component in the first transform function to a brightness component. The first 
transform function changes the brightness value range of a subject-copy image so that it may be 
equivalent to all the range of an effective brightness value within a video processing system. The 
second transform function changes the saturation value range of a subject-copy image so that it 
may be equivalent to all the range of an effective saturation value within a video processing 
system. These transform functions offer the brightness optimized completely and the 
emphasized image with a saturation component. The emphasized image is obtained by assigning 
the effective dynamic range of the brightness and saturation of a video processing system the 
optimal. Emphasis brought near by the both ends of a field, without saturation and brightness 
making color distortion mix is performed. 
[0009] 

[Example] It turns in the direction which improves the condition of an image in order [ which has 
been perceived by human being ] to reach or to ** more preferably to computer analysis, and 
the image enhancement technique shown here is ********. The first example emphasizes a 
color picture, without dropping the fidelity of an image, and the 2nd example emphasizes the gray 
level document image which carried out the optical scan by decreasing dotage and making the 
contrast of a light-and-darkness field increase. The video processing system which is 
recognizing current existence can enforce the image enhancement approach shown in the real 
time here. The desirable equipment of both the AT & T Picasso still picture telephone which is a 
video processing system, and such a conventional-type video telephone includes the 
microprocessor and the image memory. The AT & T Picasso still picture telephone is indicated 
by the U.S. application 08th under continuation / No. 202608. 

[0010] A color picture can be emphasized very more more effectively among HSV (hue, 
saturation, brightness) color space rather than the inside of RGB (red, green, blue) color space 
about the first example. All over HSV color space, it is removed from the image component 
(saturation and brightness) which the color information (hue) was separated and remains. 
According to this approach, saturation and brightness will be emphasized as much as possible to 
the maximum, without mixing distortion in a color (hue) component. Some color pictures are re- 
expressed by most pixels in HSV (hue, saturation, brightness) color space. For example, the 
approach learned well is used in order to change NTSCSECAM, conventional RGB, or a 
conventional PAL video signal into HSV color space. In some cases, it realizes by performing 
count relative [ this conversion process ] and simple, but in other cases, non-linearity 
mathematical actuation is required. Such nonlinear actuation is highly attached on count. Since it 
is such, after the image enhancement in other color space is discussed, by publication just 
below, image enhancement is taken into consideration within the environment of HSV color 
space. 

[0011] Every color picture shows the finite range of saturation and brightness. Furthermore, 
these saturation and brightness values are distinguished as each two or more components of an 



image in HSV space. Functions for the conventional video processing system to process the 
finite range of saturation as well as the finite range of a brightness value are preparation ******. 
However, the range of the **** value which the image expresses does not necessarily need to 
be the same as that of the dynamic range of the whole brightness value with which the 
conventional video processing system is equipped. It is not necessary to make not necessarily 
the same as that of all the dynamic ranges of two or more saturation values with which the 
conventional video processing system is equipped for the purpose of processing the range of the 
saturation value which appears into an image similarly. 

[0012] Generally, the effective dynamic range of a video processing system reaches the range 
very larger than the brightness in a color picture, and the range of a saturation value. If the 
image enhancement approach is not used for an image from this, some effective dynamic ranges 
of a video processing system will not have use **. If an image is underexposure, the part in 
which the brightness value concentrated on one side of the effective dynamic range of a video 
system, and the dynamic range remains will seldom be used relatively. If an image is 
overexposure, similarly the part in which the brightness value was centralized on other parts, and 
the dynamic range remains will not be used. 

[0013] The first transform function is applied to the brightness value of an image, in order to use 
appropriately the effective brightness value dynamic range of a video processing system. The 
second transform function is applied to the saturation value of an image, in order to use 
appropriately the validity of a video processing system, and a saturation value dynamic range. 
The hue of a subject-copy image is not changed. The purpose of the first function is assigning 
appropriately the dynamic range of the brightness value given by the video processing system so 
that it may be equivalent to the dynamic range of the brightness value in a original color picture. 
The purpose of the second function assigns appropriately the dynamic range of the saturation 
value given by the video processing system so that it may correspond to the dynamic range of a 
saturation value with which it was contained in the original color picture. 

[0014] The first transform function is a piecewise linear mapping function in two-dimensional 
[ with three substantial linearity fields appointed on the four brightness value points ]. The first 
dimension of a brightness input value is meant, and the 2nd dimension of a brightness output 
value is meant. The first brightness value point expresses the minimum brightness value of the 
given image, and the second brightness value point expresses the maximum brightness value of 
this image, and the third and the fourth brightness value point are chosen by the first and the 
second mean value. Selection of the special value over the third and the fourth brightness value 
point becomes settled with extent of exposure of the given image. 

[0015] Now, drawing 1 is referred to. The graph of the transform function corresponding to 
mapping of the brightness component of a color picture. Image enhancement is carried out to a 
brightness component by changing the brightness value of an image using the piecewise linear 
mapping function 102. A piecewise linear mapping function consists of between [ of three ] 
railroad sections. 104,106,108. 104 between railroad sections is defined by between vmin and 
vlower, 106 is defined by vlower and the vupper point, and 108 is defined by vmax and the vupper 
point, vmin and vmax express the maximum minimum intensity level, vlower and vupper opt for 
dynamic range allocation to a medium with a low intensity level, and the high range. 
[0016] The brightness value range of a subject-copy image is classified to vmin and vmax. After 
it, based on the property of the image emphasized, vlower and vupper are chosen in order to 
optimize image enhancement to the given image. For example, if the subject-copy image which it 
is going to emphasize is underexposure, vlower and vupper should be chosen towards 
emphasizing to the direction of a low intensity level. Thus, most effective dynamic ranges of a 
video processing system should be assigned to a low brightness range. Such assignment is 
attained by choosing vlower which becomes a value near vmin relatively, and choosing vupper 
which becomes a far value from vmax relatively. By this approach, a high intensity level is 
compressed and a low intensity level is elongated. 

[0017] If a subject-copy image is overexposure, it should be made for vlower to become far from 
vmin relatively so that it may become close to vmax relatively. A low intensity level is 
compressed by this approach, and a high intensity level is elongated. Most dynamic ranges of a 
video processing system are assigned to a high intensity level. 



[0018] Drawing 1 contains the function 103 which carries out same mapping to the second 
transform function indicated later about an image saturation value. 

[0019] Two or more characteristic count is carried out about drawing 2 and drawing 3 by 
creating a brightness value histogram to the image with which vupper and vlower are 
emphasized. Such a histogram is the range of vmin to vmax shown below, and classifies the 
range of the brightness value which appears into the image given toward most subranges. The 
number of pixels of the image which has two or more brightness values in this subrange is 
determined to each of most subranges. Conceptual attachment of the 1st moment of a 
histogram is carried out at the appearance which is the center of gravity of a histogram. The 
center of gravity is calculated by the following [-one number]. 
[Equation 1] 



[i Express ** and a characteristic intensity level and it is hi. Intensity level [i It is the number of 
pixels which it has, and N is the total of an intensity level (two or more subranges). For example, 
an intensity level 301 ( drawing 3 ) is an intensity level 1 (11). Conceptualized so that it may re- 
express, an intensity level 303 is an intensity level 2 (12). It is conceptualized so that it may re- 
express, and an intensity level 319 is conceptualized so that an intensity level 10 (110) may be 
re-expressed. In this example, there is an intensity level (the following ten subranges) of ten 
pieces, and N is equal to 10. 

[0020] Drawin g 2 expresses the brightness component in the typical color picture 207 to which 
most changes from a pixel 201,203,205. Each pixel 201,203,205 is related with the characteristic 
value showing the brightness component to the pixel. For example, 203 which 201 is white, and is 
decided to be relatively expressed as a value with high brightness, and is expressed with the 
diagonal line expresses the middle brightness value of 201 to 205. 

[0021] Drawing 3 is a brightness value histogram which shows relative distribution of the 
brightness component to the color picture 207 of drawing 2 . The brightness value histogram is 
given with a characteristic brightness value, and shows the number of pixels of a ******** 
image. The X-axis expresses an intensity level for the frequency of occurrence in a pixel unit to 
a Y-axis. In the example of drawing 2 and drawing 3 , it is used for a different brightness value of 
ten pieces expressing the pixel brightness value of an image. About drawing 3 , the lowest 
brightness value is expressed with 301 (white), and two or more middle brightness values are re- 
expressed by the brightness values 303, 305, 307, 309,311,313,315, and 317, and the highest 
brightness value is re— expressed with the brightness value 319 (black). The brightness value 
histogram of drawing 3 shows that the color picture 207 includes the brightness value 305 of 303 
or 22 brightness values of 48 brightness values [ 301 or 14 ] etc. the 1st moment of a brightness 
value histogram is the brightness value 301 which is a brightness value containing many of pixels 
in this example, all comes out, and has 48 pixels. 

[0022] The 1st moment of a brightness value histogram is given so that the given relative 
underexposure or excess of an image may be shown. To an underexposure image, the 1st 
moment becomes near by vmin ( drawing 1 ), and approaches vmax to an overexposure image. If 
based on the 1st moment of a brightness value histogram ( drawing 3 ), two intensity-level 
vlower(s) and vupper(s) will be calculated so that the 1st moment may approach vmin gradually, 
vupper will increase, and vlower will decrease. Along with steps ******, vupper decreases to 
vmax, and the 1st moment increases vlower. 

[0023] All the dynamic ranges of a video processing system are given by [VMIN, VMAX], and 
VMIN and VMAX equivalent to the min of brightness and maximum are expressed within a video 
system. In that case, a video system constitutes a video display, and VMIN and VMAX are 
chosen so that it may correspond to the min and the maximum brightness value which dare be 
displayed. The brightness value between vmin and vlower is classified into the range of [VMIN, 
VLOWER] which has the relation of VLOWER=VMIN+ {(vlower-vmin) /3} in linearity. The 
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brightness value between vlower and vupper is classified into the range of [VLOWER, VUPPER] 
which has the relation of VUPPER=VMAX+ {(vmax-vupper) /3} in linearity. The brightness value 
between vupper and vmax is classified into the range of [VUPPER, VMAX] in linearity. Before 
receiving VUPPER and VLOWER, it is the point which the place where the denominator of a 
formula includes the value 3 should note. This value is shown to the actual purpose. For example, 
the value which has shifted from 3 like 2.5 or 3.7 is used. Furthermore, a different value (namely, 
4.0) faces the value used in the denominator (namely, 2.3) of VLOWER, and is used in the 
denominator of VUPPER. 

[0024] The classification of two or more brightness values as shown by the clause just front is 
given, and makes suitable arrangement of the dynamic range of a **** video processing system 
the actual range of two or more brightness values which appear in the image which should be 
emphasized. 

[0025] The 2nd transform function is used for changing two or more saturation components of a 
subject-copy image into the saturation component for an emphasis image. This 2nd transform 
function is determined by giving an expanding procedure to the saturation histogram showing two 
or more saturation components of a subject-copy image. The minimum saturation value of an 
image is expressed again, and, as for the first saturation value point smin, the second saturation 
value point smax expresses the maximum saturation value of an image again. 

[0026] The upper limit Supper of saturation is defined like the saturation level, is the range under 
a saturation histogram from the level, and is equal to the rate that the total number of pixels in 
an image is small. [ of the maximum smax of the saturation ] For example, a desirable percentage 
becomes 0.5% of all the numbers of pixels about. It is classified into all the dynamic ranges of an 
effective saturation value [SMIN, SMAX] in linearity within a video processing system, and two or 
more saturation components of smin to supper within the limits are ****. In this approach, small 
dispersion in the saturation value of two or more pixels is disregarded without spoiling the 
integrity of the emphasized image. 

[0027] The brightness and saturation value of a subject-copy image are corrected using the 1st 
and 2nd transform function. Two or more hue components of an image do not change, but the 
same component as an emphasis image remains from a subject-copy image. Emphasis which can 
carry out the maximum activation also of the brightness value of a subject-copy image to use in 
the operating environment of the video processing system chosen as arbitration like the color 
saturation value was carried out The result becomes the emphasized optimal color picture 
without mixing of color distortion. 

[0028] In some system applications, it is sometimes impossible to decide the effective dynamic 
range of the video processing system which carries out image enhancement. For example, it is 
the case where image enhancement is carried out using some of video processing systems 
chosen as much arbitration which the dynamic range property of a video processing system is 
not known, or has the property which is different, respectively. In such application, the 
combination from which the 1st and 2nd transform function differs can be applied to each video 
processing system, and the group of each transform function is optimized to each video 
processing system here. Or 1 set of the transform function decided to be arbitration is applied 
again, and the function is chosen here in order to give useful conversion to the large range of a 
video processing system, even if the function is not suitable for use at all by the system of a 
certain. 

[0029] For a start, two or more of the techniques shown in said clause with regards to the 
second transform function will be applied to color space other than HSV, even if such application 
does not necessarily bring about two or more optimal results. The process in which other color 
space is changed into HSV to a field is often intensive on count, and the system located 
extremely is required. About some system application [ like ] which is the video telephones which 
communicate using an NTSC video signal, the count demanded requires the very expensive 
hardware which is not desirable. 

[0030] In addition to the complexity of count, the process in which non-HSV color space is 
changed into a HSV field causes other problems. Two or more colors with a certain clear color 
space are not realized physically in other color space. For example, the color of some [ the 
YCbCr color space of the conventional NTSC video signal ] will be changed into the 



complementary color in RGB color space. Such the complementary color is not realized 
physically. 

[0031] In consideration of two or more aforementioned difficulties in the case of changing non- 
HSV color space into a HSV field, one means is shown as emphasizing a color picture directly in 
NTSCYCbCr color space conventionally. This means is applied to every video equipment which 
operates it in the real time and carries out color picture record in an NTSC format. 
[0032] The brightness (Y) component of the conventional NTSC signal is emphasized following 
two or more procedures shown above about the brightness component of a HSV color picture. If 
the color difference components Cb and Cr are corrected with the same amount like a 
brightness (Y) component, the same thing will remain like [ in a subject-copy image ] in color 
saturation. It can check through the mathematical induction which the fact that color saturation 
remains with the same value is known to this contractor, and is indicated by JIEI Fawley (J. 
Foley) work "computer-graphics principle and operation" Addison Wesley (Addison-Wesley) 
publication and 1991. However, in order to emphasize the optimal color picture, the saturation 
component of an image is correctable in order to improve the saturation of an image further. 
[0033] Detection of the color information number in an image is carried out by deciding the 
amount of the breadth of the histogram of Cb and Cr component. When small, the threshold 23, 
for example, most, to which the breadth of a histogram was given, after that, a document image 
is treated like a gray level image, and only a brightness component is emphasized. 
[0034] One possible approach against text image enhancement is extending Y histogram even to 
the maximum effective dynamic range, and, thereby, is emphasizing image contrast. Even if this 
attempt improves an image, further two or more improvements are possible. According to the 
means shown here, the background gray level of a document image is decided. Generally two or 
more text images contain the relative limited number of discrete gray levels, and even case 
[ whose alphabetic character is / like / in black / the binary document of a white background, or 
others ], they are the same. A background gray level shows an effective peak within Y 
(brightness) histogram. Such a brightness histogram resembles the brightness value histogram 
closely. The peak in Y (brightness) histogram is detected when a peak detection signal checks 
the gray level in the place of 0 which changes from negative to forward. The peak detecting 
signal was generated by calculating the difference between an accumulation histogram and the 
graduated accumulation histogram, and the degree of the smoothing has determined the 
sensibility of peak detection. 

[0035] Two or more saturation components of an NTSC image correct the color difference 
components Cb and Cr, and are emphasized with more amounts than the amount of the 
emphasized brightness component Y. In other words, it should increase more than having applied 
the inclination of a transform function to the color difference component (color difference 
transform function) having applied the inclination of a transform function to the brightness 
component (brightness transform function). When a luminance-signal component is relatively 
corrected to the large range, this shows that a subject-copy image is relatively unsaturated. The 
correction by the brightness component transform function is in inverse proportion to the 
amount of saturation in a subject-copy image. When saturation is relatively low, it should be 
increased from this by saturation so that saturation may be proportional in relation to a high 
environment relatively. 

[0036] As one means to investigate the amount of the saturation which should be increased, 
there is an approach by calculating deflection from the linearity of a brightness transform 
function. It is conceptualized so that the Y-axis showing a brightness output may be 
conceptualized in relation to drawing 1 so that a brightness output level may be expressed now, 
and the X-axis may express a brightness input level now. An absolute difference is searched for 
among the piecewise linear mapping functions 102 and 103 from each of many intensity levels. 
Two or more absolute differences which receive all the intensity levels are summed up in order 
to obtain all the deflection that comes from the linearity shown by Dev after that. After it, in 
order that the following formulas may calculate the value of incr, it is used, incr is used in order 
to decide the amount by two or more color difference components which should be increased. 
1.0<(incr=Dev/8000) <=2.0. In a denominator, the value of 8000 is a typical value which shows 
the purpose of illustration. The value expressed with two or more of other figures, for example, a 



value like 7000 which offers only effective actuation, is applied to the denominator in the location 
of 8000. 

[0037] If drawing 6 is referred to, it will be what re-expressed in the graph the transform 
function which maps Cr color difference component of a color picture, and the transform 
function to drawing 7 mapping Cr color difference component of a color picture will be re- 
expressed in a graph, incr is hung in order that the inclination of the piecewise linear mapping 
function 102 ( drawing 6 , 7) to the range [vlower, vupper] ( drawing 1 ) may ask for the 
inclination of a color difference transform function. The actual min of the color difference of a 
subject-copy image and the maximum level are classified into all the color difference component 
dynamic ranges of ( drawing 6 and 7). The flake 105 equivalent to the color difference level 128 
to both Cr ( drawing 6 ) and Cb ( drawing 7 ) is classified into itself according to a color 
difference transform function. Using brightness and a color difference transform function, the 
brightness and color difference component value of a subject-copy image are changed in order 
to generate the emphasized optimal image directly in YCbCr color space. YCbCr color space is 
used in the conventional PAL and the environment of a SECAM logic NTSC video signal. 
[0038] As for other examples shown here, a gray level text logic document image decreases 
dotage of an image, and they are emphasized by making the contrast between the light-and- 
darkness fields of an image increase. These gray level images are re-expressed for example, in 
NTSCYCbCr color space. The main purposes of document image enhancement are increasing 
the readability of a document. Since the readability of a document is decided by the brightness 
component of an image, this means has put the chief aim on emphasizing a brightness (Y) 
component. When the color information on the given image is restricted very much, the color 
difference components Cb and Cr do not need some processings. Cb and Cr are processed by 
the appearance shown by the immediately above-mentioned clause when that is not right. 
[0039] One peak in Y histogram expressing a background gray level must be detected to the 
purpose of this example. A script (namely, text image) depends for this detection process on 
whether it has a high gray level background or it has a low gray level background. The first peak 
which starts with the maximum shade level in a histogram to a high gray level background, and 
appears within a histogram is a background gray level. Starting from the minimum shade level in a 
histogram to a low gray level background, the peak of the beginning in a histogram is a 
background gray level. 

[0040] A text image has the high gray level background shown like ybkg to the purpose of this 
example. In the above condition, the selection to positioning of a background gray level is only 
because the first peak is only shown from the gray level edge where Y histogram is high. 
However, Y histogram should be first graduated using the conventional smoothing technique, 
otherwise a retrieval process positions a peak by local within the limits which has relative Bure 
while it is completely missing in a big peak rather than it expresses an actual background gray 
level. 

[0041] The minimum foreground value of the document is shown as ymin, and can be decided by 
investigating Y histogram from the edge of the low gray level. While searching, since it is 
dependent on few [ the total number of pixels ] rates, the slight minimum value of the beginning 
is disregarded. Few of this rate is near 0.1% like an example, and that approach makes it possible 
to exclude two or more slight Bure relatively in two or more gray levels by which the text image 
was observed by this. 

[0042] The contrast of a text image is emphasized by mapping Y (brightness) component in 
[YMIN, YMAX] from [ymin, ybkg]. this comes out in the range of the minimum of a video 
processing system, YMIN which is a maximum Y value, and YMAX. Before mapping Y value, the 
technique known by this contractor as Anh Sharp masking is applied to Y component of a whole 
image in order to remove many Bure from a text image. This sharp-ized actuation causes the 
appearance of the "bulk" which is not very desirable as the custom to human beings eye around 
an alphabetic character. These umbrellas are caused by the overshoot within the pixel value 
more than the background gray level ybkg, and after mapping the umbrella of these plurality from 
Y value [ymin, ybkg] to [YMIN, YMAX], it can be easily removed by two or more standard 
approaches learned by this contractor. Before applying the Anh Sharp masking to an image, the 
mapping function should be decided, otherwise, background level cannot detect correctly, but it 



cares about that it becomes impossible for two or more umbrellas to already remove. 
[0043] Based on the text image enhancement approach shown here, taking the property of an 
actual text image into consideration, an approach removes dotage from an image effectively and 
makes contrast the maximum. Furthermore, when compressed into a format like JPEG which is 
the technique in which the text image and the emphasis image are known now, few blocking 
artifacts appear in an emphasis image relatively. The reason with few blocking artifacts is that an 
emphasis image contains a more uniform background and two or more foreground gray levels. In 
spite of describing the text image enhancement approach in the environment of YCbCr color 
space, only the approach is applied also to other color space. 

[0044] Drawing 4 puts the color picture which serves as an example in actuation of a color 
picture emphasis procedure here, and expresses it as a picture. In order to try effectiveness of 
the approach shown here, the quality of the actual proof image 400 was degraded by hand, and 
the test image 402 was given. The example image 400 and the test image 402 can be set to 
YCbCr color space. The first emphasis image 404 is an emphasis image obtained when a 
transform function is applied only to Y component of the test image 402. The color of the image 
404 which was predicted above and which was emphasized like is not relatively emphasized to 
the test image 402. 

[0045] The 2nd emphasized image 406 is an image obtained when a transform function is applied 
to the brightness and color difference component of the test image 402. The color distortion 
caused by the interaction between various color components is observed clearly, in order that 
some types of a color amendment device may explain the interaction between various color 
components and may remove such color distortion — using — if there is nothing, it will not 
become. 

[0046] The 3rd emphasized image 408 is an image obtained when all of a commercial image- 
processing software package are used. These software packages include the device which 
amends the color distortion which generally causes an interaction between various color 
components. Even if the color is not distorted, these conventional technical software packages 
will not offer the optimal emphasis image. 

[0047] The test image 402 may be emphasized the optimal using the approach it was indicated 
that indicated above in relation to drawing 13 here. Such an image emphasized the optimal is 
shown in drawing 4 . the approach of these plurality shown here when the operation image 400 
compared each emphasis image 404,406,408,410 — whenever [ contrast and color ] — the 
maximum — what is emphasized even on practical level is observed. Furthermore, two or more 
approaches shown here do not supply color distortion. 

[0048] Drawing 5 is an illustration showing application of two or more gray scale image 
enhancement procedures shown in the document used as an example scanned optically here. 
The text images 500 are some text images obtained from the AT & T Picasso still picture 
telephone. The AT & T Picasso still picture telephone is shown in the United States patent 
application 08th under connection / No. 202608. The emphasis image 502 is prepared in order to 
use Y histogram expanding process which was subordinate with the Anh Sharp masking, as 
shown above. It is observed that contrast is not optimized and two or more umbrellas are mixed 
by the masking process. The emphasized image 504 was generated from the background gray 
level which it was prepared in order to use the mapping function shown above, and was detected. 
It is the point that the place where some dotage appears attracted attention. The emphasized 
image 506 was prepared in order to use two or more means shown here. The contrast of an 
image is optimized and it is observed that it was removed that it is indistinct. 

[Translation done.] 
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JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 
[Brief Description of the Drawings] 

[Drawing 1] It is drawing which graph-ized the function to mapping of the brightness component 
of a color picture. 

[Dra wing 2] It is drawing showing the brightness component to the typical color picture which 
consists of many images. 

[Drawing 3] It is the histogram which shows relative distribution of the brightness component to 
the image of drawing 2 . 

[Drawing 4] It is drawing showing implementation of two or more color picture emphasis 
procedure shown in the image used as an example here. 

[Drawing 5] It is drawing showing application of two or more gray scale image enhancement 
means shown here to the document used as an example which carried out the optical scan. 
[Drawing 6] It is drawing which graph-ized the transform function to mapping of Cr chromaticity 
of a color picture. 

[Drawing 7] It is drawing which graph-ized the transform function to mapping of Cb chromaticity 
of a color picture. 
[Description of Notations] 
400 Subject-Copy Image 

402 Image to which Quality was Lowered by Hand 

404 Application of Transform Function to Y Component 

406 Application of Transform Function to Brightness and Color Difference Component 
408 [mage Emphasized Using Commercial Image-Processing Software 
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(7) #P**P8- 2 5 1 4 3 2 

12 

l/^taSo 1. 0< (i ncr=Dev/8000) ^ 
2 . 0o ^Stfc^T8 0 0 OCttti, 091E4)gtt$jF 

t*tf*aw:iifiF^»3-*a#t'rs 7 0 oooiws 

[0 0 3 7] H6^#^-TSt, X^-m»<DC rfeM 
<DX\ ZLXmHts rfiMSMV'y 

10 if y ^"-rs c i: fctt-f sgfftBSRfc ^7fcSSlL/c 

tOT'SSo §§19 [vlower, vupper] (0 

i ) ictttz&fimMB-? >y ^yfmm. 102 (06, 
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tr*>e>T*«„ ^Stt3ftfE&&£\ YCbCr*7- 

fti t # 5 -&mcft l x fc jgffl a ft 5 o 
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